Not with a Bang: Weakly Explosive Percolation in Directed Networks 
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Percolation, the formation of a macroscopic connected component, is a key feature in the descrip- 
tion of complex networks. The dynamical properties of a variety of systems can be understood in 
terms of percolation, including the robustness of power grids and information networks, the spread- 
ing of epidemics and forest fires, and the stability of gene regulatory networks. Recent studies have 
shown that if network edges are added "competitively" in undirected networks, the onset of perco- 
lation is abrupt or "explosive." The unusual qualitative features of this phase transition have been 
the subject of much recent attention. Here we generalize this previously studied network growth 
process from undirected networks to directed networks and use finite-size scaling theory to find 
several scaling exponents. We find that this process is also characterized by a very rapid growth in 
the giant component, but that this growth is not as sudden as in undirected networks. 
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I. INTRODUCTION 

A complex network is a collection of nodes, along with 
a set of edges which join pairs of nodes. In an undirected 
network, in which each edge may be traversed in both 
directions, the network can be divided into distinct con- 
nected components. As edges are successively added to a 
large undirected network, it may transition from a non- 
pcrcolating phase, in which every connected component 
is microscopic, to a percolating phase, in which there is a 
single "giant" component which contains a macroscopic 
fraction of the nodes in the network pQ. The fraction of 
nodes in the giant component is the order parameter for 
the percolation phase transition. 

The percolation phase transition on undirected net- 
works was independently discovered by Solomonoff and 
Rapoport [2J and Erdos and Renyi [3] and later gener- 
alized by other authors [TJ 0] . The network growth pro- 
cess studied by Erdos and Renyi, now the prototypical 
example of network percolation, may be characterized 
as follows. The network initially consists of N ^> 1 
nodes and no edges. Then, on each successive step of 
the growth process, a pair of nodes is selected randomly 
and an undirected edge is added between them. The size 
of the largest connected component is recorded and the 
process is repeated. The percolation phase transition for 
networks grown in this manner is second-order (contin- 
uous) in the number of edges in the network. However, 
recent work by Achlioptas et al. demonstrated that sim- 
ple modifications to this growth algorithm can induce 
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surprisingly different behavior in the growth of the giant 
component [5 . In particular, they found that introduc- 
ing "edge competition" during network growth results in 
"explosive percolation," a delayed, seemingly first-order 
(discontinuous) transition. Explosive phase transitions 
with similar properties have since been reported in nu- 
merous specially prepared undirected network systems, 
including Kuramoto [6] and Ising [7] models, as well as 
percolation processes on scale-free networks jS], lattices 
[S], and empirical biological networks |10) . 

The network growth process proposed by Achlioptas et 
al. is designed to inhibit the formation of large connected 
components. At each step, two random candidate edges 
are considered, with the intention of selecting only one 
of them for addition to the network. If one of the edges 
connects two nodes in the same component, it is selected 
automatically because its addition would not cause any 
component to grow. If the addition of either edge would 
connect two distinct components, the product of the sizes 
of these two components is compared, and the edge with 
the smaller product is chosen to be added to the net- 
work |llj . Networks grown in this fashion percolate much 
later than Erdos-Renyi networks; however, when a giant 
component eventually forms, it grows extremely rapidly. 
Based on numerical simulations, Achlioptas et al. con- 
jectured that the phase transition is first-order, but it 
has now been shown that the Achlioptas process actu- 
ally produces a second-order transition [T2lU5| . The ex- 
plosive growth observed in numerical experiments is due 
to the fact that the model exhibits strong finite-size ef- 
fects which diminish only very slowly as N — > oo. In 
spite of this, explosive percolation continues to attract 
considerable interest because, at network sizes that are 
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Giant in-component (GIN) 



p = 2E/N 

FIG. 1. The growth of /gc, the fraction of nodes in the giant 
component of an undirected network, for three individual net- 
works with N = 2 23 . The growth process is repeated using 
the Erdos-Renyi growth process (red), the Achlioptas pro- 
cess (blue), and a modified Achlioptas process in which three 
candidate edges, rather than two, are used at each network 
growth step (green). 



typical in applications, these finite-size effects give the 
percolation phase transition an "effectively" first-order 
appearance that is qualitatively different from that of 
traditional percolation problems (see Fig. [lj. 

In this paper, we extend the concept of explosive perco- 
lation to directed networks. In a directed network, each 
edge can only be traversed in one direction. Directed 
networks are widely used to model gene regulation, food 
webs, neural networks, citation networks, the world-wide 
web, and other systems. However, the existing literature 
on explosive percolation is exclusively focused on undi- 
rected networks. Here, we explore a generalization of the 
Achlioptas process to directed networks and study the 
scaling properties of this process. We find that compet- 
itive edge percolation on directed networks shares some 
of the qualitative features of explosive percolation, but 
these features are less pronounced than for the Achliop- 
tas process on undirected networks. 



II. METHODS 

In order to define an Achlioptas-like process on di- 
rected networks, we first need to define connectedness 
on a directed network. Although there is a single unam- 
biguous definition of a "connected component" for undi- 
rected networks, there are multiple related definitions for 
directed networks pQ. In the algorithms discussed be- 
low, we will study four different types of structures to 
which a node may belong. In the giant component, these 
structures are commonly illustrated with the well-known 
"bow-tie diagram" (Fig. 2]) [16]. First, the in-component 
of a node i, IN(z), is the set of all nodes which have 
paths to i. Likewise, the out-component of i, OUT(i), 




Giant out-component (GOUT) 

FIG. 2. An illustration of the "bow-tie" structure of the gi- 
ant component in a directed network above the percolation 
threshold (see text). 



is the set of all nodes which can be reached on paths 
from i. Next, the strongly connected component of i, 
SCC(i), is the intersection of IN(i) and OUT(i). Fi- 
nally, we define the full bow-tie, BT(i), to be the union 
of lN(i) and OUT(i) [T7]. Each of these structures is 
in some sense analogous to the connected component in 
undirected networks. This comparison extends to the 
percolation transition in the directed Erdos-Renyi pro- 
cess, in which directed edges are successively added be- 
tween randomly selected, unconnected pairs of nodes. 
At the critical point, a giant strongly connected com- 
ponent (GSCC), giant in-component (GIN), and giant 
out-component (GOUT) form simultaneously if], com- 
prising the giant bow-tie (GBT). For convenience below, 
we will use G to denote any one of the parts of the giant 
component of a directed network (GSCC, GIN, GOUT, 
or GBT), or for the giant component (GC) of an undi- 
rected network. See Table [I] for a list of acronyms. 

Now, we describe a new network growth processes on 
directed networks. We will refer to this process as the di- 
rected competition process (DCP) to distinguish it from 
the Achlioptas process (AP), the Erdos-Renyi process 
(ER), and the directed Erdos-Renyi process (DER). It 
consists of repeatedly choosing two random directed can- 
didate edges i\ j\ and 12 — > 32 from the set of all dis- 
tinct unoccupied edges, then using a minimization rule to 
select one for addition to the network. As in the Achliop- 
tas process, we automatically select one of the edges if 
that edge is redundant to the connectedness of the net- 
work, i.e., if there is already a path from i to j. Oth- 
erwise, we select the edge for which |IN(z)| • |OUT(j)| is 
minimized. Here, the vertical bars denote cardinality, so 
|IN(i)| refers to the number of nodes in IN(i). We also 
consider generalizations of both AP and DCP in which 
m edges (rather than two edges) are chosen for consid- 
eration at each step in the growth process, and we will 
discuss results for both m = 2 and m = 3. Note that the 
m = 1 case of AP corresponds to ER, and the m = 1 
case of DCP corresponds to DER. 

Our edge selection rule may be motivated by noting 
that it minimizes the "throughput" which is created by 
the addition of each edge in a way which is analogous 
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Acronym 


Definition 


ER 


Erdos-Renyi process 


AP 


Achlioptas process 


DER 


Directed Erdos-Renyi process 


DCP 


Directed competition process 


GC 


Giant component 


GSCC 


Giant strongly connected component 


GIN 


Giant in-component 


GOUT 


Giant out-component 


GBT 


Giant bow-tie 



TABLE I. Acronyms commonly used in the text. 



to the Achlioptas product rule. More formally, let Py 
indicate whether or not there is a path from i to j, i.e., 
Pij = 1 if there is such a path and P^ = if there is not. 
The throughput of the network can be defined as T — 
(P) , where the average is taken over all node pairs i and j 
(i 7^ j). Well below the percolation threshold, when there 
are few paths from nodes in IN(i) to nodes in OUT(j), 
adding an edge from i to j on average increases T by 
approximately |IN(i)| • |OUT(j)|/A 2 . Similarly, in the 
Achlioptas process for an undirected network, the change 
in T from the addition of a single edge to a network well 
below the percolation threshold is approximately 2|C(£)| • 
\C(j)\/N 2 , where G(i) and C(j) are the components to 
which i and j belong. Thus, both rules may be construed 
as minimizing T early in the network growth process. 
This, in turn, leads to an explosive phase transition by 
creating what has been termed a "powder keg" [18] of 
mesoscopic components which "ignites" at the critical 
point, when edge competition can no longer prevent them 
from merging. 

For the order parameter of each phase transition, we 
will use the normalized size Jq of a giant component, 
where 
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We define the GSCC to be the largest strongly connected 
component in the network, the GIN and GOUT to be its 
in- and out-components, and the GBT to be the union 
of the two |19j . For the tuning parameter, we will use 
the average degree of the network, p. For undirected 
networks, p = 2E/N, whereas for directed networks, p — 
E/N [20]. Note that, for undirected networks, our use of 
p as the tuning parameter differs slightly from the usual 
convention of using E/N as a tuning parameter. Our 
use of the average degree is motivated by the observation 
that both undirected and directed Erdos-Renyi networks 
percolate at the same average degree (p c = 1), so p is 
a natural scale for comparison between the directed and 
undirected cases. 

Computationally, percolation simulations are more 
time-intensive for directed networks than undirected net- 




0.8 
0.6 
0.4 
0.2 




■ (c) 




r 


{- 




f 




i 
i 








i 




1 • 


i 


i 

i i i 







2 3 4 5 

p = E/N 



6 7 



• DER • DCP (m=2) • DCP (m=3) 



FIG. 3. The formation of (a) the giant strongly connected 
component, (6) the giant out-component, and (c) the giant 
bowtie in a directed network with N = 2 23 . In each panel, 
the results for the directed Erdos-Renyi process (red) are com- 
pared to those for the directed competition process using ei- 
ther m — 2 (blue) or m = 3 (green). Results for GIN are 
omitted due to symmetry with GOUT. 



works. While only O(N) operations are needed to sim- 
ulate an entire network growth process in an undirected 
network |22j , a naive algorithm for competitive edge per- 
colation in a directed network would require at least 
(D(N 2 ) operations, because there are O(N) edge addi- 
tions, between each of which several processes with up to 
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Network Growth Rule 


Pc 


6 


Component 




'/ 


A 


m= 1 ER 


1 


1/3 


GC 


1 


0.328(7) 


0.30(9) 


DER 


1 


y a 


GOUT 


1 


0.329(3) 


0.31(9) 








GSCC 


2 


0.64(7) 


0.50(5) 


m = 2 AP 


1.7769(8) 


0.5(0) 


GC 


0.0861(5) 


0.0645(5) 




DCP 


2.565(9) 


0.44(1) 


GOUT 


0.34(5) 


0.14(1) 


0.12(9) 








GSCC 


1.2(9) 


0.55(8) 


0.53(3) 


m = 3 AP 


1.92(9) 


0.50(1) 


GC 


0.03(0) 


0.020(7) 




DCP 


4.86(1) 


0.42(7) 


GOUT 


0.30(0) 


0.10(5) 


0.09(3) 








GSCC 


1.(4) 


0.40(7) 


0.4(9) 



TABLE II. Critical exponents for each process (see text). For ER and DER, p c , 6, and j3 are well-known exact results (see, e.g., 
[3] and [IS]). For AP with m = 2, we reproduce p c , 8, and j3 from [T3] and r\ from |21) ; refer to [T3] for additional comments 
about the interpretation of 6. All other exponents listed above are derived from our numerical simulations, as described below. 
Due to symmetry, results for GIN are identical to those for GOUT, and results for GBT are not listed because, in most cases, 
they are similar to those for GOUT. 



O(N) steps must occur. These processes include check- 
ing for a path from i to j for each prospective edge i — > j, 
finding IN(t) and OUT(j'), and decomposing the network 
into strongly connected components [23] . In order to im- 
prove computational performance, we track each part of 
the giant component during the network growth process 
and use knowledge of the giant component to speed up 
or eliminate the first two processes. For example, if i is 
in GIN and j is in GOUT, checking for a path from i to j 
is unnecessary because one must exist. Additionally, we 
report results only for the giant component, not the dis- 
tribution of other component sizes, to avoid the third pro- 
cess. This results in an algorithm which scales approxi- 
mately as 0(N 1 - 5 ), where most of the time is spent in the 
critical region where more than one macroscopic or near- 
macroscopic component exists. This improvement en- 
ables the simulation of networks with significantly larger 
N than would otherwise be feasible. 



III. RESULTS 

Plots of the order parameters versus p are shown in 
Fig. [3] for large- N single-network realizations of the DER 
and DCP growth processes. When edge competition is 
present, the emergence of all four parts of the giant com- 
ponent are delayed, and the GOUT and GBT display 
sudden growth at the critical point which is qualitatively 
similar to (though less marked than) that of the Achliop- 
tas process (Fig. [I]) . (Results for GIN are not shown in 
Fig. 3 since, due to symmetry with GOUT, they are the 
same as those for GOUT.) In order to make quantitative 
comparisons, we measure several scaling exponents which 
can be used to characterize the features of explosive per- 



colation 13 -15] [2T] HI]- In fact, the Achlioptas process is 
striking precisely because these exponents are small (see 
Table SB, but it is continuous because they are nonzero. 

The first such measure is the critical exponent /3, de- 
fined by 

(f)-(p-Pcf (2) 

as p — > p c from above, for networks in the thermodynamic 
limit N — > 00. The average (•) is taken over the ensemble 
of grown networks. Clearly, /3 > indicates a continuous 
transition, as has been observed for AP in [T3][TJ]. Next, 
we report another exponent 77, defined by 

(max(A/)) ~ AT", (3) 

where max(A/) is the largest jump in / upon the addi- 
tion of a single edge during a network growth process. 
In a discontinuous phase transition, the maximum jump 
would approach a nonzero constant as N — > 00, but 77 has 
been observed to be small and positive for AP [T51 [2T] . 

Finally, we introduce a third scaling exponent A, de- 
fined by 

max(Var[/]) - N~ x (4) 

p 

for sufficiently large N. This is motivated by the ob- 
servation in [T5] that, for the Achlioptas process, the 
maximum variance of / initially increases as N grows, 
then begins to decrease very slowly when N is extremely 
large. This is related to other unusual finite-size effects 
in AP; see [T3] for a thorough discussion. In a continuous 
transition, we expect that Var[/] — > for all p in the ther- 
modynamic limit, so A > 0. Moreover, a small value of 
A indicates that for finite N, there may be large changes 
in / near the critical point (i.e., explosive behavior). 
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FIG. 4. Collapse of (/gout) for DCP (m = 2) using various 
values of N onto the universal scaling function h(z), accord- 
ing to Eq. Q. The first eight curves are averaged over 10,000 
network growth processes, and the last two are averaged over 
5,000 and 2,500 respectively. For these values of N, the col- 
lapse is excellent up to z ~ 4. Similar collapses are used to 
fit the values of p c , 8, and /3 reported in Table [III 



Both rj and A may be determined by a straightforward 
fit to a power law using a weighted sum of squares (see 
Figs. [5] and [6]). The critical exponent (3, as well as the 
critical point p c , are more difficult to estimate. To do 
this we analyze the finite-size scaling properties of the 
system. Sufficiently close to the critical point of a con- 
tinuous phase transition, the order parameter / is hy- 
pothesized to obey the finite-size scaling relation 



(f) = (p-Pcfg{N e (p-p c )), 



(5) 



where 9 determines the scaling of the width of the critical 
region and g is a universal scaling function |13) . This may 
be written in the equivalent form 



(f) = N-^h(N e (p- Pc )), 



(6) 



where h(z) = z"g(z) is another universal scaling func- 
tion. 

Unlike g(z), h(z) is not singular at z = [21]. There- 
fore, Eq. (|6| may be interpreted by saying that plots of 
(/) versus z = N (p — p c ) for various values of N will all 
collapse, when appropriately scaled, onto h(z), when z is 
near (i.e., p rj p c ). We choose /3, 9, and p c to optimize 
this data collapse (see Fig. Specifically, we choose /?, 
9, and p c to minimize the function 



A: 



V((3,9, Pc )= V^ N [N^ e (f(z,N))]dz (7) 



A2 



where Az is not too large. For further details, see [25] , 

The results in Table [n] summarize the important fea- 
tures of DCP and how they relate to both DER (the anal- 
ogous non-explosive case) and AP (the analogous undi- 
rected case). For the GSCC, /? and 77 are lower in DCP 
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FIG. 5. Scaling of the maximum jump in the each part of 
the giant component of directed and undirected networks as 
a function of N. The results for (a) the GSCC (diamonds), 
(6) the GOUT (squares), and (c) the GBT (triangles) are 
compared in each panel to the results for undirected networks 
(circles). In addition, ER and DER (red) are compared to 
AP and DCP with m = 2 (blue) and m — 3 (green). Lines 
are power-law fits, whose slopes are given as rj in Table |TT| 
Each point is averaged over many network growth trials (50 
to 10, 000, depending on m and N). Error bars (one standard 
deviation in the mean) are smaller than the point size for all 
points. 



than in DER, but are not small enough to lead to interest- 
ing behavior; therefore, we will focus on GOUT from here 
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FIG. 6. Scaling of the largest variance in (a) /gc (circles) 
and (6) /gout (squares) as a function of N, for m = 1 (red), 
m = 2 (blue), and m = 3 (green), using data from the same 
simulations as in Fig. [5] Solid lines are power-law fits whose 
slopes are given as A in Table [II] dashed lines merely connect 
the data points to guide the eye of the reader. One unusual 
feature of AP is that the maximum variance of / increases 
with N, for N not too large (see text), but then eventually 
decreases; DCP does not share this feature. 



forward. We see that (3 and rj are significantly smaller in 
DCP than in DER, but not nearly as small as in AP. This 
provides quantitative support for our characterization of 
DCP as "weakly explosive" in contrast to explosive tran- 
sitions, in which < /3 -C 1 and < r\ -C 1, as well 
as "non-explosive" transitions, in which /3 and rj are on 
the order of 1. It is clear that DCP belongs somewhere 
between these two previously-studied regimes. 

Several other features of Table [TT] are worth noting. 
For example, in the Achlioptas process, /3 and rj change 
quite significantly when m is changed from 2 to 3, but the 
corresponding changes for DCP are comparatively small. 
This suggests again that the amount of edge competition 
has a more pronounced effect on the critical behavior of 
undirected networks than directed networks. However, 
the opposite is true of the critical point p c , which, for 
successive values of to, increases by a much greater factor 
for directed networks than for undirected networks. If 
one views the purpose of edge competition as delaying the 



formation of a giant component rather than producing an 
explosive transition, then this goal is better achieved by 
DCP than by AP. 

Finally, in Fig. |6j we see that DCP lacks the unusual 
scaling behavior observed for AP in [13]. Although the 
values of A for the giant out-component in DCP are 
smaller than those for DER, again indicating weakly ex- 
plosive behavior, it is nonetheless clear that they are pos- 
itive. On the other hand, in AP, a much more detailed 
analysis is required to show that Var[/] eventually ap- 
proaches for all p as N — > oo (see [T3J). Therefore, we 
do not report A for AP, but merely note the qualitative 
differences between AP and DCP. 



IV. DISCUSSION 

We have shown that an extension of the Achlioptas 
process to directed networks exhibits critical behavior 
which is, in many respects, partway between classical per- 
colation and explosive percolation, which we have termed 
weakly explosive percolation. This has several interesting 
ramifications for future research on controlling or modify- 
ing percolation phase transitions. One fundamental open 
question is how general the phenomenon of explosive per- 
colation is, and whether the explosiveness of a percolation 
process can be predicted in a relatively straightforward 
way. From the perspective of classical percolation, the 
primary distinguishing features of the Achlioptas net- 
work growth process are that it is irreversible [T3] and 
uses nonlocal information |13j : however, there are clearly 
such processes which are not explosive (see, for example, 
[2"tj]). The strong explosiveness of the Achlioptas process 
may be contingent on several factors, and the present 
work suggests that the use of undirected networks is one 
of these factors. 

Another avenue for further research is the possibility 
of tailoring percolation transitions with particular fea- 
tures. For example, different growth rules may create 
different complex network structures. In Fig. [3] nearly 
all network nodes have joined the giant bowtie soon after 
the critical point, but this is not true of the giant in- or 
out-components until p is quite large [37| . While it is be- 
yond the scope of this paper to investigate this feature, it 
suggests that there is additional interesting structure in 
networks grown through the directed competition process 
which cannot exist in undirected networks. More impor- 
tantly, it may be possible to control the critical point 
and the critical behavior of the giant component by us- 
ing a mix of directed and undirected edges in the network 
growth process. Because the Achlioptas process produces 
a more explosive transition, but the directed competition 
process delays the onset of criticality for longer, this may 
produce some degree of control for both features. Along 
with the above results, this suggests that further study 
of competitive percolation processes on directed networks 
will widen the known repertoire of percolation behavior 
in fascinating ways. 
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